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ABSTRACT 

Students' macroprocessing of instruction was studied 
in a learning situation which used adjunct questions. The subjects 
were offered various macroprocessing options while reading a passage 
on data processing and computer programming. Each sentence appeared 
on a computer CRT screen one at a time. The options included: (1) 
review any sentence or sentences; (2) preview any sentence or 
sentences; (3) consult an alternative text written in an easier 
vocabulary; (4) review the alternate text; (5) preview the alternate 
text; (6) take notes; (7) review the notes; (8) view an outline of 
the 49-paragraph presentation; or (9) view and salect from a menu of 
options. Tests of reading, worry, test anxiety, and study skills were 
administered. Three groups were assigned: only reading the text; 
reading and responding to adjunct questions after each screen; or 
reading, answering questions, and receiving feedback. The computer 
system monitored which options were selected, as well as the 
frequency and time requirements. The results suggested that students 
did not select options which optimized individual achievement; in 
fact, they may not have krtown which macroprocesses to use to improve 
learning. (GDC) 
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Macroprocesses , Individual Differences and Instructional Methods 

Sigmund Tobias 
City College, C.U.N.Y. 
Abstract 



This paper reviews the theory and research dealing with 
students cognitive processing of instruction, or macroprocess:? ng . 
The results of a study tracking students macroprocessing of 
instruction in an adjunct question context are reviewed and 
implications for further research on macroprocesses discussed. 
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Macroprocesses , Individual Differences and Instructional Methods 

Sigmund Tobias, 
City College, CUNY 



An implicit assumption of all the papers in this symposium is 
that learning from instruction depends critically on the frequency 
and intensity of student cognitive processing of instruction^ 
Doyle (1978) has called these cognitive activities mediating 
processes, Salomon (1982) talks about the amount of invested 
mental effort, abbreviated as AIME, and I have called them 
macroprocesses (Tobias, 1982, 1983). The concepts associated with 
my colleagues on this symposium, whether Wittrock's (1974) 
generative learning strategies, Peterson and her colleagues' 
(1983) student cognitions, or Rohrkemper and her colleagues' 
(1983) inner speech all fit easily under any of these labels. 

Since I am most comfortable with the term macroprocesses, let 
me describe these, and attempt to distinguish them from other 
related labels. By macroprocesses I mean those relatively molar 
cognitive processes students use when they learn from meaningful 
instruction, such as reviewing, previewing, looking for 
clarification, and the like. These could, of course, also be 
called study skills or metacognitive strategies and it may be 
useful to differentiate between these constructs. Study skills, 
as used by Weinstein (1983), by Dansereau and his colleagues 
(1979), and by others, (Brown & Holtzman, 1970) imply both 
cognitive activities and affective states such as anxiety, 
motivation, attitudes and the like. Macroprocesses, on the other 
hand, denote only the cognitive processes used by students to 
learn from instruction. As indicated previously (Tobias, 1983) 
metacognitive strategies (Flavell, 1979; Brown, .1980) imply some 
degree of self-monitoring of one's knowledge; macroprocesses do 
not carry that implication. 

Along with the other participants in this symposium I believe 
macroprocesses to be critical in enlarging our understanding of 
meaningful learning. Cognitive processing of instruction is 
important not only because it is a truism that the type of 
macroprocessing determines what and how much is learned; equally 
important is the fact that students are aware of the 
macroprocesses they use. It is hoped that awareness of these 
activities means that the processes can be controlled and, if 
necessary, altered. 

As indicated elsewhere (Tobias, 1982, 1983) my interest in 
macroprocesses came from an attempt to understand conflicting 
findings dealing with the achievement treatment interaction (ATI) 
problem. ATI research, of course, investigates interactions 
between student individual difference characteristics, or 
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aptitudes and different instructional treatments (Cronbach & Snow. 
1977). I have, preferred the term achievement treatment 
interaction (Tobias, 1976, 1982). Since that descriptor also 
gives rise to the ATI abbreviation, that makes life convenient for 
everyone . 

One assumption of instructional research in general is that 
alternate methods induce different types of macroprocessing . 
Surprisingly, there is relatively little research substantiating 
this most basic assumption. My colleagues on this symposium and 
others around the country are hard at work in an attempt to 
develop evidence to substantiate this assumption. For an ATI 
researcher, however, evidence that alternate instructional, methods 
engage different types of macroprocessing is only one third of the 
job. Another third is that different macroprocesses should be 
used by students with different affective or cognitive 
characteristics, or that similar macroprocesses should be used 
with different frequencies. The final third of the ATI 
researcher's task is to establish an interaction between the 
macroprocesses engaged by instructional methods, and those that 
are characteristic of students at varying points of individual 
difference 1 dimensions. It should be obvious that in the absence 
of firm empirical support for either of the f?i-st two assumptions 
evidence for the third will be difficult to obtain. One can 
readily see why ATIs have been difficult to find, difficult to 
replicate, and sometimes impossible to understand. 

Our task, then, is to conduct the kind of research which will 
ultimately allow us to infer that different instructional methods 
will, in fact, lead to alternative cognitive processing for 
specified students. The other presenters at this symposium have 
described the ways in which they have attacked this general 
problem. Peterson and Swing (1983) and Rohrkemper et al (1983), 
like Winne and Marx (1982), have previously investigated the 
macroprocessing problem by stimulating the recall of students 
regarding cognitive processes employed during a class lesson. In 
such research, lesson videotapes are typically viewed and students 
interviewed regarding their prior cognitive activities. In 
another study Winne (1982) used an adjunct question paradigm, and 
trained students in the strategies they were to use. Salomon 
(1982) studied macroprocesses by developing a questionnaire asking 
students to rate the mental effort invested during different 
types of instruction. 

We have taken a aomewhat different .pproach to this problem. 
Rather than relying on either sel f -report , or stimulated recall we 
hoped to track the processes used by offering students various 
macroprocessing options while learning from text. Students' use 
of options was monitored while they studied materials displayed by 
microcomputer p^d constituted our operational definition of 
macroprocesses. n M9 paragraph passage was developed introducing 
students to general concepts of data processing and computer 
programming, and illustrated by a few instructions in the BASIC 
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language. Sentences were numbered, and appeared on a CRT screen 
one at a time. When students finished a sentence and pressed the 
space bar the sentence was erased, though the space it occupied 
and its number remained on the screen. This slight artificiality 
was required in order to exercise most of the options to be 
described below. 

All students could choose any of these options: They could 1) 
review, or 2) preview any sentence, or group of sentences. 3) 
Students could consult an alternate text written with easier 
vocabulary (10th grade level on the Frye formula, compared to 14th 
grade for the original passage) at the end of every paragraph. The 
alternate passage was also more clearly organized than the main 
passage with respect to super-ord inate and subordinate paragraph 
structure. 4) The alternate text could be reviewed, or 5) 
previewed. 6) Students were able to take notes on the computer 
system, 7) and review their notes. 8) An organizational display 
could be requested containing all the headings in the main and 
alternate text, the sentence numbers covered by each heading, and 
the number of the sentence students were presently reading. 9) A 
menu of the options available, and how these could be invoked 
could also be requested. 

In order to assure that students were aware of the available 
macroprocessing options and understood how to invoke them, a 
preliminary program was prepared. This program described each of 
the options, how it was invoked, and required students to use 
every option before proceeding. In this way, we could be sure 
that students knew how to use each option prior to starting the 
instructional passage. Both the preliminary and main programs 
enabled students to invoke the macroprocesses with minimal time 
delays, averaging about half a second each. 

In addition to the options described above, student 
volunteers participating in this experiment were administered a 
multiple choice pre-test (Alpha r eliability= . 75 ) ; only those with 
raw scores of less than 60% were used in the study. In addition, 
the following measures were administered: The Nelson-Denny 
Reading Test, Sarason's (1980) Test Anxiety Scale, plus five 
scales from Weinstein's (1983) Learning and Study Skills 
Questionnaire. Morris, Davis & Hutching's (1981) Worry and 
Emotionality instrument was also administered several times during 
the study. Finally, after students completed reading the material 
a constructed response posttest was administered. The alpha 
reliabilities of the posttest were: incidental .85, relevant .86, 
and total .92. 

In this experiment we examined whether instructional 
conditions implemented via different text presentation modes 
changed the frequency and type of macroprocesses used. Students 
were randomly assigne 1 to three conditions: 1) Merely reading the 
text; 2) reading the text and responding to adjunct questions 
appearing after every screenful; 3) reading, adjunct questions 
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and receiving feedback regarding the accuracy of responses. In 
accord with the procedures widely used in prose investigations we 
categorized the posttest and the text sentences as to whether they 
were relevant, or incidental °to the adjunct question. The 
macroprocessing data were also categorized so that we could 
determine whether the options were invoked to select an 
incidental, or a relevant text segment. Finally, the program 
retained whether the options were selected from an incidental or 
relevant text segment, and noted the frequency as well as time 
required for option use. 

In addition to having objective data regarding use of 
macroprocesses , another motivation for utilizing this computer 
based procedure was that we had hoped to avoid the mass of 
transcribed data Rorhrkemper et al (1983) t Peterson and Swing 
(1983) and their colleagues had to wade through to conduct their 
data analyses. We were hoping for a neat and clean data set. 
Needless to say, once the research was completed we found 
ourselves with 55 rows of data, each containing up to 74 
characters, and a total of 225 variables for each of 120 or so 
students. So much for neat and .clean data sets. 

Table 1 displays means and standard deviations for some of 
the major dependent and independent variables in this study, as 
well as descriptive data on the sample. 



Insert Table 1 about here 



Multivariate regression analysis of the post t..~t results 
indicated that, as expected, pretest contributed significantly to 
the posttest scores. Also as expected, there were significant 
differences among groups in achievement on both the relevant and 
incidental part of the posttest. Both groups with adjunct 
questions had higher scores than those in the read-only group. 
There was also a main effect attributable to worry, a component of 
test anxiety (Morris, et al 1981), indicating that anxious 
students learned less than those lower in anxiety. None of the 
interactions among these variables were significant. 

The means and standard deviations for the macroprocessing 
options, and percentage of people not employing any of the 
options are displayed in Table 2. 



Insert Table 2 about here 



The most striking aspect of these results was the incredible 
variability for most of the macroprocessing data. The percentage 
of students who did not use an option at all varied from 18 to 
8856. At the other extreme, there were a number of students who 
used these options very frequently. The standard deviations for 
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these variables attest to the large variability. In order to 
reduce the effects of outliers we set the data of students whose 
use of any of these options fell over three standard deviations 
above the mean at the three st< idard deviation value. Despite 
that, it is evident that the '"Mlicy is still very large 

indeed. Table 2 also display <s correlations of each of the 
options with incidental, relevant, a., total posttest scores. 

Multivariate regression analysis of the option data indicated 
an overall difference for the three groups, with significant 
univariate effects ^or use of alternate text and for notetaking. 
In general the group receiving feedback used the options least 
frequently, and the adjunct question group most frequently. 
Neither worry nor pretest score exerted any overall effect on the 
data, nor did the interaction among any of the variables. 

It hsd been assumed that use of the options would be an index 
of the intensity of cognitive processing of the subject matter. 
There is support for this expectation in our data. As indicated 
above, ths group receiving feedback used all of the options less 
frequently than the other groups. The significant achievement 
differences among the groups parallel the macroprocessing 
frequency data. That is, the adjunct question group used the 
greatest number of options and learned most and the feedback group 
used the fewest options and learned least. These data, then, 
support the assumption that the frequency of option use was 
related to the intensity of macroprocessing, which, in turn 
probably contributed to the amount learned. While option 
selection may not have been wise, as discussed below, the 
frequency of such use did seem related to intensity of processing. 

The macroprocessing and achievement differences between the 
adjunct question and feedback groups confirms some expectations 
concerning the relationship between instructional support and 
achievement (Tobias, 1982). It was argued that when an 
instructional sequence does for students what they can do for 
themselves;, the intensity of cognitive processing is reduced and 
consequently, that learning is lowered. In this study the 
feedback may have given students the type of instructional support 
that the adjunct question group had to provide for themselves. 
The greater utilization of instructional options by that group 
suggests that the processing of the material was more active and 
intense presumably accounting for the higher achievement. 

The selection of instructional options by students presented 
something of a paradox in that two opposing student strategies 
seemed apparent in the data: 1) Invoke no options, 2) or invoke 
as many options as possible. Option data suggest that bo of 
these tendencies may have been present. Summing over the totals 
for all groups indicates that options were not used by a mean of 
60% of the students. On the other nan ' , some students invoked 
each of the options with incredible frequency. For example, one \ 
student u:ied the preview option 168 tines in a 173 sentence 
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passage! Clearly, it is hard to justify student's use of options 
with such frequency as being in the service of improving 
comprehension . 

One possible explanation for the variable option use may be 
that students do not know which strategies to employ when they 
encounter learning difficulties. The excessive option use by some 
students may indicate a relatively random, trial and error 
pattern of jumping from one type of macrcpr ocessing to another in 
an attempt to seek help. Students may have been unaware of which 
strategies \.ere most effective to help them master the material . 
There are some data to confirm this interpretation. For example, 
use of* the options was uncorrelated with any of the scores on the 
Nelson-Denny Reading Test If options were selected to improve 
comprehension, some relationship with the reading indices would, 
of course, have been expected. Since, as indicated above, there 
is some reason to believe that option use was related to the 
intensity of macroprocessing, we suspect that student inability to 
choose options which were most likely to improve their achievement 
may well be the major reason for the variability in the selection 
of macroprocessing data. A final reason for the variability of 
option use may be that some students invoked few options so as to 
complete the task as quickly as possible. 

I think that there is an important lesson to oe learned from 
these data. Students apparently do not select instructional 
strategies or options which are ideally suited to. them, or which 
optimize achievement. In fact they may not know which 
macro processes to use to improve learning. The research results 
dealing with students' preference for instructional methods 
(Tobias, 1972), and research on the issue of learner control of 
instruction have also indicated that students do not use 
instructional strategies wisely. 

We are now planning a test of these interpretations. In 
this study we were interested merely in observing the type of 
options used by students voluntarily. We were strongly 
influenced in this strategy by significant findings emerging in 
the rasearch relating teacher behavior to student achievement 
(Rosenshine & Stevens, 1981; Brophy, 1979) » In that field research 
was begun with low inference observational schemes in order to 
determine relationships between student learning and teacher 
behavior. We have learned from our research that apparently 
students do not choose macroprocess - ' ng options wisely. 

In our future research we intend to prescribe student option 
selection in terms of performance on adjunct questions. That is, 
we plan to use some groups for whom option use will be determined 
by the accuracy of responses to adjunct questions. For example, 
one condition in our next study will require students to review a 
preceding screenful of text if their answers to adjunct questions 
are wrong. We are also investigating the possibility of 
prescribing use of the easier text version for other students 
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depending upon their scores on the reading test, and their 
response to comprehension questions. In addition, of course, we 
shall also employ groups with free choice of options to explore 
whether prescribing option use improves achievement. I hope that 
by the time next year's AERA contention rolls around that we will 
have some information on these questions, in addition to the 
variety of provocative questions aroused whenever student's 
performance in meaningful instructional situations is subjected to 
careful scrutiny. 
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Table 1. 



Mean and Standard Deviations for Various Variables 
in Macroprocessing Study, by Group. 



Variables 



Adjunct Adjunct 
Questions Questions 
plus Feedback 



Read 
Only 



Posttest Incidental 



Posttest Relevant 



Posttest Total 



Pretest Incidental 



Pretest Relevant 



Pretest Total 



13. 14 
5.40 

17.56 
5.28 

30.70 
10.13 

8. 34 
3.74 

11.10 
4.43 

19.45 
7.41 



14.84 
5.86 

17. °0 
6.00 

32.74 
11.48 

8.51 
2.87 

12.26 
3.82 

20.77 
5.77 



11.99 
5.05 

13.91 
5.16 

25.89 
9.47 

7.74 
3.03 

11 .37 
3-38 

19.12 
5.45 



Anxiety Variab >s 
Test Auxiety 

Worry-Pretest 

Emotionality-Pretest 

Worry-Program 



17.00 
6.46 

8.16 
3.67 

7.39 
3.85 

9.24 
3.91 



17.97 
8.28 

8.62 
4.28 

8.05 
4.66 

9.62 
4.66 



19. *(4 
6.35 

8.6? 
3.84 

6.67 

2-33 

9.33 
4.04 
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Table 1 continued. 



Anxiety Variables Continued 
Emotional ity-Program 

Worry-Posttest 

Emotional ity-Postteat 

Nelson-Denny Reading Raw Soores 
Vocabulary 

Comprehension 

Total 

Study Skills 
Motivation 

Self-Testing 

Self-Scheduling 

Attitude 

Information Processing 



Adjunct Adjunct Read 
Questions Questions Only 
plus Feedback 

7.53 7.03 8.05 
3.68 2.58 3-56 

8.59 9.76 11,86 

3.26 4.61 5.57 

7.22 7.50 7.79 

3.54 3.87 3-56 

41.18 42.51 38.23 

21.13 23.75 22.27 

29.60 30.74 27.28 

14.69 18.32 16.27 

71*.58 72.18 65.44 

31.48 18.32 36.65 

28.08 31.13 30.77 

7.29 8.89 8.75 

17.22 16.53 16.33 

4.20 3.60 3.18 

17.14 14.40 15.13 
3.64 4.42 4.63 

7.06 7.34 6.85 

3.01 3.00 2.73 

64.30 55.11 58.18 

10.68 10.08 13.16 
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Table 2. 



Mear.s and Standard Deviations of Option Use, 
Percentage Not Using Each Option, 
and Correlations with Posttests 



Adjunct Adjunct Read 

Questions Questions Only 
plus Feedback 



Macroproces3infc Frequency Data 

1 

Preview Incidental 



M 
SD 
r = 



.55 
1.70 
-.22 



1.02 
2.22 
. 14 



1.13 
2.11 
.05 



Preview Relevant 



Preview Total 



3 



Review Incidental 



1 



M 

SD 
r = 



%**not using 
M 

SD 
r = 



.50 
1.16 
-.30* 



1.05 
2.51 
-.35* 
69 



5.77 
12.17 
-.05 



.72 
1.56 
.10 



1.74 

3-54 
.14 

59 



9.53 
12.83 
.37* 



.49 
1.10 
.03 



1 .63 
3.04 
.06 

58 



6.19 
11.01 
.39** 



Review Relevant 



M 

SD 
r = 



3.78 
8.18 
-.02 



6.70 
9.82 
.36* 



3.74 
7.44 
.33* 



Review Total 



Alternate Text Incidental 



1 



M Q.55 

SD 20.06 

r - -.03 

jT'not using 54 



M 2.53 
SD 7.06 
r = -.23 



16.23 
22.24 

.37* 

42 



23. 14 
29.06 
.15 



9.93 
18.19 
.40** 

49 



9.95 
17.46 
.16 
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Table 2, part 2 



Alternate Text Relevant 



M 

SD 
r 



2,21 
6.14 
-.20 



14.35 
18.60 
. 10 



5.44 
10.55 
.09 



Alternate Text Total 



M. 

SD 

JL = 

5f"not using 



1 

Review-Alternate Incidental M 

SP 
r = 



n.74 

13.04 
-.21 

69 



1.84 
8.78 
. 26 



37.50 
47.32 
. 14 
52 



2.23 
4.95 
.13 



15.40 
27.48 
.14 
41 



2.14 
6.21 
-.23 



Review-Alternate Relevant 



M 

SD 
r 



.42 
1 .62 
.22 



2.06 
5.29 
.11 



1 .32 
3.64 
-.24 



Review-Alternate Total 



1 



Notes From Incidental 



M 2.28 

SD 10.36 

r = .24 

5t""not using 88 



M 2.92 
SD 4.72 
r = .26 



4.29 
9.94 
.14 

88 



3.79 
5.28 
.22 



3.46 
9.75 
-.27 

71 



6.19 
7.27 
.19 



Notes From Relevant 



M 

SD 
r - 



.87 
1.56 
.43** 



1.74 
2.64 
. 18 



2.92 
4.22 
.10 



Notes Total 



M 

SD 

r_ = 

% not using 
1 



Review-Notes from Incidental M 

SD 
r = 



3.79 
5.98 
.33* 
47 



.21 
.70 
.27 



5.54 

7.67 
.21 

32 



.48 
.84 
. 16 



9.10 

10.97 
.20 

18 



.62 
1 .24 
.25 
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Table 2, part 3 



Review-Notes from Relevant M 

SD 



r = 



.08 
.36 
.25 



.20 
.52 
.23 



.30 
.58 
.11 



Review-Notes Total 



Headings from Incidental 



1 



M 

SD 
r = 

% not using 



M 

SD 
r = 



.29 
.96 
.30 
86 



.39 
.86 
.14 



.69 
1 .09 
.22 
67 



.6': 

1.21 
.31 



.92 
1 .64 
.28 
74 



.91 
1.28 
-.07 



Headings from Relevant 



M 

SD 
r = 



.18 
.56 
-.18 



.27 
.57 
-.20 



.48 
.78 
-.16 



Headings Total 



M .58 

SD 1.11 

r = -.11 

l~"not using 72 



1=Correlated with Incidental Posttest 
2=Correlated with Relevant Posttest 
3=Correlated with Total Posttest 



.92 
1 .53 
.13 
70 



1.58 
1.93 
-.11 

57 



* = p. < . 05 

**= £^ < .01 
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